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Abstract. Recent observation for scale invariant neural avalanches in the brain have been discussed 
in details in the scientific literature. We point out, that these results do not necessarily imply that the 
properties of the underlying neural dynamics are also scale invariant. The reason for this discrepancy 
lies in the fact that the sampling statistics of observations and experiments is generically biased by 
the size of the basins of attraction of the processes to be studied. One has hence to precisely define 
what one means with statements like 'the brain is critical' . 

We recapitulate the notion of criticality, as originally introduced in statistical physics for second 
order phase transitions, turning then to the discussion of critical dynamical systems. We elucidate 
in detail the difference between a 'critical system', viz a system on the verge of a phase transition, 
and a 'critical state', viz state with scale-invariant correlations, stressing the fact that the notion of 
universality is linked to critical states. 

We then discuss rigorous results for two classes of critical dynamical systems, the Kauffman 
net and a vertex routing model, which both have non-critical states. However, an external observer 
that samples randomly the phase space of these two critical models, would find scale invariance. 
We denote this phenomenon as 'observational criticality' and discuss its relevance for the response 
properties of critical dynamical systems. 
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INTRODUCTION 

The notion of criticality stems from statistical mechanics and is fundamentally related 
to the deeply routed concept of universality [1, 2]. As critical equilibrium systems 
show scale invariance it is natural to assume that the same would hold for critical non- 
equilibrium systems [3, 4]. The situation is however substantially more complex for 
classical dynamical systems far from equilibrium and the subject of our deliberations. 
The discussion will revolve around three central concepts. 

CRITICAL SYSTEM A system is denoted critical when being located right on the 
transition point of a second order phase transition [5, 6]. 

CRITICAL STATE The state of a thermodynamic or dynamical system is denoted critical 
when exhibiting scale invariance [5, 7]. Critical thermodynamic systems dispose 
always of a critical state, critical dynamical systems not necessarily. 

OBSERVATIONAL CRITICALITY The experimental observation of a dynamical system 
generically involves a stochastic sampling of its phase space. Scale invariance may 
be observed for a critical dynamical system which does not dispose of a critical 
state [8, 9, 10]. 
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FIGURE 1. Illustration of a second order phase transition. The low-temperature phase is characterized 
by an order parameter which drops continuously to zero at the critical temperature T c . The system becomes 
increasingly susceptible to perturbations coupling to the order parameter close to the transition point, the 
respective response functions diverge algebraically. 



This dichotomy is caused by the difference between mean and typical properties. 
It turns out that for critical dynamical systems the scaling behavior of the typical 
attractor may differ qualitatively from the scaling of the mean attractor, as defined 
by randomly sampling a phase space. 

We will start by recapitulating the central notions of the theory of critical thermo- 
dynamic systems, stressing the fact that the scale invariance, which is observed in this 
case, is deeply intertwined with the concept of universality. We will then discuss two 
examples of critical dynamical systems for which the scaling behavior at criticality is, at 
least in parts, exactly known. 



In statistical physics a phase transition is termed a second order phase transition when 
the ordering process starts continuously at the critical temperature T c , when lowering the 
temperature T of the system, compare Fig. 1 . Otherwise, when the low-temperature state 
discontinuously appears, one speaks of a transition of first order. The theory of critical 
phenomena deals with second order phase transitions [11]. 

Scaling towards criticality. For a second order phase transition there are precursors 
of the impending transitions, which can be measured experimentally using appropriate 
probes. For example, applying an external magnetic field to a ferromagnetic system will 
lead to a strong response, in terms of the induced magnetization, close to the transition. 
In general this response will diverge as 
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where y > is the critical exponent 1 . Power-laws like Eq. (1) are denoted scale invariant, 
as they do not change their functional form when rescaling the argument via \ T — T c \ — > 
c\T — T c \, where c > is an arbitrary scaling factor. 

Critical state. At criticality, T = T c , the thermodynamic state is very special, its 
correlation function being scale invariant both in the spatial and the temporal domain. 
For a magnetic system, with moments S(x) at x, the equal time correlation function 

D(r) ee D(x-y) = <S(x)S(y)> - (S) 2 
obeys the scaling relations 

D(r)~{ & ~ r/ l l*l< , Socr-^-r, (2) 
v i i r - a t = t c ' * \t-t c \ z 

with t, being termed the correlation length and z the critical dynamical exponent [12, 13]. 

Absence of microscopic length scales. The scaling of the correlation function (2) is 
very intriguing, since it implies that all microscopic scales (length, time, energy, etc.) 
become irrelevant at criticality. As an example consider the Schrodinger equation 
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which determines the properties of most matter we know. The Schrodinger equation 
contains two scales, the Rydberg energy E R = 13.6eV, which determines the energy 
level spacing, and the Bohr radius ao = 0.53A, which determines the extension of the 
atoms. Any Hamiltonian known is characterized by corresponding scales, but these 
become irrelevant at criticality and do not determine the magnitude of the critical 
exponents. 

Universality. The symmetry of the high-temperature phase is broken at a second 
order phase transition. For example, in a magnetic systems with classical moments, 
these magnetic moments point in any direction for T > T c , the symmetry of the high 
temperature phase is 0(3), the symmetry group of the sphere. In the low-temperature 
phase the magnetic moments point however predominantly into a specific direction, 
breaking spontaneously the 0(3) symmetry of the order parameter. 

A central result of the modern theory of phase transitions is now that the critical 
exponents are determined solely by two factors: the dimensionality of the system and 
the symmetry of the order parameter. This relation is termed 'universality' as it al- 
lows to classify second order phase transitions into a relatively small number of dis- 
tinct classes [5, 1,2]. Results obtained using a given microscopic model are valid for 
all models within the same universality class. Universality is the core to our understand- 
ing of second-order phase transition, the scale invariance of the critical state being a 
manifestation of it. 
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FIGURE 2. The evolution of the order parameter of the NK-network. Shown is the overlap, as given by 
Eq. (4), in the long-time limit, of two initially close trajectories. In the frozen state the overlap becomes 
maximal, since the two trajectories flow into the same attractor. In the chaotic state two initially close 
states diverge, the Lyapunov exponent is positive. 



BOOLEAN NETWORKS 

In equilibrium thermodynamics one studies systems in the thermodynamic limit where 
the number of components N becomes infinitely large, N — > °°. Phase transitions hence 
take place, in statistical physics, in systems made-up of many similar units. We consider 
here an equivalent setting for non-equilibrium phase transitions. A dynamical system 
can be described as a set of N differential equations, 

-^xi(t) = fi(xi,..,XN;r]), i=l,..,N, (3) 

where /, determines the time evolution of the dynamical variables Xi(t) which are related 
to each of the system's elements. Here 77 denotes a generic control parameter. Random 
Boolean networks are defined by three specifications [14]. 

Boolean variables The variables Xj e {0,1} are Boolean and the time t = 
0, 1,2, . . . discrete. 

RANDOM COUPLING FUNCTIONS The coupling functions are Boolean, E {0, 1}, 
and selected randomly. 

connectivity The coupling functions are determined by only a subset of K ran- 
domly selected controlling elements and not by all N Boolean variables. Hence the 
term 'Boolean network' . The control parameter K is denoted connectivity. 

Random Boolean networks are also termed NK- or Kauffman nets [15]. They show a 
phase transition for connectivity K — 2, being regular for Z < 2 and chaotic for Z > 2 
[16]. 

K<2 \ K = 2 I K> 2 
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FIGURE 3. There are many cyclic attractors in the phase space of boolean networks and routing models. 
Each attractor comes with its distinct basin of attraction, which is made up of the cycle itself together with 
all points of phase space flowing into the attractor. 



The order parameter is given by the overlap 



of two initially close trajectories x(f) and y(t), where ||..|| denotes the Manhattan 
distance, that is, the sum of the absolute differences of coordinates of x and y. In the 
frozen phase the overlap is maximal, since close-by trajectories will end up in the 
same attractor, see Fig. 2. The dynamics becomes chaotic however for Z > 2, and two 
trajectories diverge, with their mutual overlap decreasing. 

Attractors and cycles. The time evolution of any dynamical network with finite 
phase space, which is Q. = 2 N for the ./VAT net, is determined by the number and the 
size of its cyclic attractors. The Kauffman net is critical for Z = 2 and one may ask the 
question to which extend this criticality is reflected in the statistics of its attractors. 

Any attractor comes with a respective basin of attraction, as illustrated in Fig. 3, 
defined as the set of all points in phase space flowing into the attractor. In the ordered 
phase a small number of attractors with large basins of attraction dominates phase space 
and the dynamics is hence very stable, nearby trajectories converge. In the chaotic phase, 
for Z > 2, the number of attractors is however very large and the size of their respective 
basins of attraction correspondingly smaller. Nearby trajectories tend to diverge, being 
attracted by different cycles. 

Finite-size scaling. To calculate the properties of a dynamical or thermodynamic 
system directly in the thermodynamic limit is most of the time difficult or impossible. 
Alternatively one can evaluate the quantity of interest for finite systems size N and 
then extrapolate to large system size, a procedure denoted finite-size scaling. For scale 
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FIGURE 4. Illustration of information spreading on networks. When information spreads diffusively 
(left), it may be passed on to any number of subsequent vertices. When information is conserved (center), 
the information can be considered as a package which can be passed on only to a single downstream site. 
Alternatively one can consider information routing (right), where an incoming package is routed to an 
outgoing link. 



invariant states, like the critical thermodynamic state, finite size scaling involves power- 
laws. The reason is that there are no length scales at criticality in statistical physics 
and power-laws are the only scale invariant relations. Conversely we expect finite-size 
scaling to be algebraic whenever the underlying state is critical, viz scale invariant. 

Initial numerical calculation for the Z = 2 Kauffman net did indeed find that the 
number of attractors, scales polynomial, like y/N [15]. The same scaling relation was 
also found for the mean cycle length. However it has recently been show rigorously, 
that the number of attractors actually increases faster than any power of N, viz super- 
polynomial [16, 17]. The intrinsic state of the critical Z = 2 Kauffman net is hence not 
scale invariant. 

Observational scale invariance. The phase space Q. = 2 N of the NK network in- 
creases exponentially with system size N. Numerical studies have hence to resort to 
appropriate statistical sampling of phase space. Actually, this is also what an experimen- 
tal observer would do when examining a dynamical system at a random starting time. It 
may now be the case that a relatively small number of attractors dominate phase space 
and the results of a statistical sampling procedure, see Fig. 3. 

In order to illustrate this scenario we discuss now a fictional example. Let's assume 
that there are big attractors of the order of y/N, each having on the average a basin of 
attraction of the size 

rsj 

y/N y/N ' 

There could be in addition a very large number of point attractors, each having a basin 
of attraction of size one. For example the number of point attractors could scale super- 
polynomial like 

~ 2^. 

In this case their combined relative contribution 
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FIGURE 5. Illustration of of a = 4 sites vertex routing model which has (left) three cyclic attractors. 
Note that more than one cycle can pass through any given vertex, as the phase space (right) is made up by 
the collection of the N(N — 1) = 12 directed links. 



to phase space would still vanish in the thermodynamic limit N — > °°. This is what 
happens for the Z = 2 Kauffman net. The typical attractor is very small and not seen 
by a stochastic sampling procedure. A relatively small number of big attractors with 
large basins of attraction dominate phase space and determine the statistics as sampled 
by an external observer. 



VERTEX ROUTING MODELS 

Criticality and conservation laws are intrinsically related. A branching process is critical, 
to give an example, when the average number of offspring is equal to the number of 
parents, that is, when average activity remains constant. It is hence possible to construct 
critical dynamical systems when incorporating a conservation of activity levels. An 
example for this procedure are vertex routing models [18]. 

Information can spread diffusively or via routing processes, see Fig. 4. For the later 
case one considers information packages transmitted at every vertex via randomly se- 
lected routing tables. The phase space is hence given by the collection of directed links, 
the phase space volume Q. = N(N — 1) scales algebraically. More than one cycle can 
hence pass through a given vertex. The number of cycles passing through a given model 
can be viewed as a measure for information centrality which has a non-trivial distribu- 
tion in the thermodynamic limit [18]. 

Exact solution. The routing dynamics can be mapped to a random walk in config- 
uration space, the collection of directed links, and solved exactly [19, 14]. The number 
(Cl) (A/) of cycles of length L is given by 

(r urn - N((N-mi 

{ L){ j L (N-l) 2L - l ((N-l) 2 + l-L)\ ' W 



for fully connected graphs with N vertices. In addition to the exact expression (5) for 
the intrinsic cycle length distribution of the routing model, one can also derive the 
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FIGURE 6. Exact results for the vertex routing model. The mean cycle length (left) for both quenched 
and on-the-fly dynamics and the the mean cycle number (right), which can be evaluated only for quenched 
dynamics. 



distribution of cycle length an observer would find when randomly sampling phase 
space. In this case the probability to find a given cycle of length L is weighted by the 
size of its basin of attraction. The resulting cycle length distribution is 

Lmax ((N-1) 2 V 

Algorithmically the difference between the expressions (5) and (6) is equivalent to 
quenched deterministic and on-the-fly stochastic dynamics. Quenched dynamics is 
present when the routing tables are selected once at the start and then kept fixed, whereas 
for on-the-fly dynamics one randomly generates an entrance to a routing table 'on the 
fly', viz only when needed. 

Scaling of the vertex routing model. One can evaluate the exact expressions (5) 
and (6) for very large system size N, the results are shown in Fig. 6, respectively for 
the average cycle length (L) and the overall number of cycles. Only relative quantities 
can be evaluated with on-the-fly dynamics and hence (L) but not the total number of 
cycles present. The results are given in Table 1, where we have included also results 
for a modified vertex routing model, a Markovian variant. On-the-fly routing results in 
power-law scaling for the average cycle length, in contrast to the exact properties of the 
respective model, which contains logarithmic corrections. 



DISCUSSION 

When probing a dynamical or thermodynamical system, like the brain or a magnet, one 
needs to perturb the system and measure the resulting response. The probing protocol 
may be considered unbiased when the phase space is probed homogeneously. If the 
dynamical system being probed contains attractors, or attractor relics [20, 21], these 
will dominate the statistics of the response. It may now happen that properties of the 
attractors, like the cycle length for the case of cyclic attractors, have a highly non-trivial 
statistics in the sense, that the characterizing properties of the typical attractor differ 



TABLE 1. The scaling behavior of the vertex routing model (first row) and of 
a modified routing model with nor routing memory (second row). Corrections ~ 
log (AT) are present for quenched dynamics, viz for the intrinsic model behavior. 
An observer would however obey power-law scaling, as given by the on-the- 
fly dynamics, which can evaluate only relative quantities (and not the overall 
number of cycles). 
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qualitatively from the average behavior probed by random sampling phase space. In this 
the intrinsic or typical properties of the system differ from the one an observer would 
find when sampling phase space randomly. 

We have argued in this study, that this situation does indeed occur for critical dynami- 
cal systems, at least for the classes of critical systems for which exact results are known, 
Boolean networks and vertex routing models. We believe that further investigation into 
this question is warranted for additional classes of critical dynamical systems, in order 
to examine the question whether power-law scaling is independent, or conditional, on 
universality in critical dynamical systems. This is an open issue. Here we found that the 
intrinsic state of two critical dynamical systems is not scale invariant, a property typ- 
ically associated with universality in thermodynamics, but experimentally probing the 
system stochastically would result in power-law scaling. 
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